Singh held that India wanted to engage in dialogue with Pakistan at different levels and that was why Prime Minister Narendra Modi had recently met his Pakistani counterpart PM Nawaz Sharif at Ufa in Russia.
The director general-level talks between border forces of India and Pakistan kicks off on Thursday days after parleys between their national security advisers were cancelled with the host nation set to flag the "most important" issue of ceasefire violations and cross-border infiltration.
Talks between the two sides were last held in December, 2013, in Lahore.
India can be called "more Islamic than Pakistan" as more Muslims live here than that country, Home Minister Rajnath Singh told the chief of Pakistan Rangers who called on him to discuss ways to keep the border peaceful.
The two sides, sources said, also agreed to stop ceasefire violations along the International Border "through enhanced communication via multiple modes at all possible levels".
The Indian agenda for the talks has put extra stress on the "most important" issue of breach of ceasefire in Jammu and Kashmir